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Abstract. Haglund, Luoto, Mason, and van Willigenburg introduced a basis for quasisymmetric functions 
called the quasisymmetric Schur function basis, generated combinatorially through fillings of composition 
diagrams in much the same way as Schur functions are generated through reverse column-strict tableaux. 
We introduce a new basis for quasisymmetric functions called the row-strict quasisymmetric Schur function 
basis, generated combinatorially through fillings of composition diagrams in much the same way as Schur 
functions are generated through row-strict tableaux. We describe the relationship between this new basis 
and other known bases for quasisymmetric functions, as well as its relationship to Schur polynomials. We 
obtain a refinement of the omega transform operator as a result of these relationships. 



1. Introduction 

Quasisymmetric functions have emerged as a powerful tool for investigating many diverse areas such as 
symmetric functions [H 3] , combinatorial Hopf algebras ^Ij , discrete geometry [3] , and representation theory 
[m [13] . Quasisymmetric functions were introduced by Gessel as a source of generating functions for P- 
partitions , although they appeared in a different format in earlier work by Stanley jT^ . Gessel developed 
many properties of quasisymmetric functions and applied them to solve a number of problems in permutation 
enumeration. Gessel also proved that they were dual to Solomon's descent algebra. This duality is further 
explored by Ehrenborg [S], Malvenuto and Reutenauer jTB], and Thibon |5T]. 

In [S], Haglund, Luoto, Mason, and van Willigenburg introduced a new basis for quasisymmetric func- 
tions called the quasisymmetric Schur functions which are generated combinatorially through fillings of 
composition diagrams in much the same way as Schur functions are generated through reverse column-strict 
tableaux. Each quasisymmetric Schur function is a positive sum of Demazure atoms. In [8], it was shown 
that the quasisymmetric Schur functions refine the Schur functions in a way that respects the Schur function 
decomposition into Gessel's fundamental quasisymmetric functions. In [5], Haglund, Luoto, Mason, and 
van Willigenburg gave a refinement of the Littlewood-Richardson rule which proved that the product of a 
quasisymmetric Schur function and a Schur function expands positively as a sum of quasisymmetric Schur 
functions. 

This paper was motivated by an attempt to extend the duality between column-strict tableaux and row- 
strict tableaux to quasisymmetric Schur functions That is, let A — (Ai, A2, . . . , A^) be a partition of n. The 
diagram associated to A (in English notation) consists of k rows of left -justified boxes, or cells, such that the 
i*^ row from the top contains Ai cells. A reverse column-strict tableau T of shape A is a filling of the cells of 
A with positive integers so that the rows are weakly decreasing and the columns are strictly decreasing. A 
reverse row-strict tableau T of shape A is a filling of the cells of A with positive integers so that the rows are 
strictly decreasing and the columns are weakly decreasing. Let TZCSx (resp. TZTZS\) denote the set of all 
reverse column strict tableaux (resp. reverse row strict tableaux) of shape A. If T is a reverse column-strict 
tableau or a reverse row-strict tableau, we let T{i,j) be the element in the cell which is in the i-th row of 
T, reading from top to bottom, and the j-th column of T, reading from left to right, and we let the weight. 
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C"^, of T be defined as — XT(i.j)- Then the Schur function s\{xi^X2, . . .) is defined as 



(1.1) SA(a;i,a;2, . . .) = X! 



T 
X . 



TencSx 

If T is a reverse column-strict tableau or a reverse row-strict tableau of shape A, we define the conjugate, T' , 
of T to be the filled diagram of shape A' which results by reflecting the cells of T across the main diagonal. 
Clearly T is a reverse column-strict tableaux if and only if T' is a reverse-row strict tableaux. Thus 

(1.2) SA'(xi,a;2, . . .) = ^ x'^ 

TennSx 

where A' is the transpose of the partition A, often referred to as conjugate partition (TUl HU [20] . Moreover, 
if id is the algebra isomorphism defined on the ring of symmetric functions A so that w(/i„) = e„, where 
hn = hn{xi,X2, ■ ■ ■) is n-th homogeneous symmetric function and e„ — en{xi,X2, ■ ■ ■) is n-th elementary 
symmetric function, then it is well known that 

(1.3) Uj{sx{xi,X2, ■■■))= Sy{xi,X2, ■ ■ ■) ■ 



The question that motivated this paper is whether we can find a duality like that expressed in ( 1.1 1, ( 1.2 1, 



and (1.3 1 for quasisymmetric Schur functions. In this paper, we introduce a new basis for quasisymmetric 
functions called the row-strict quasisymmetric Schur functions, which are generated combinatorially through 
fillings of composition diagrams in much the same way as Schur functions are generated through reverse row- 
strict tableaux. However, the process of conjugation becomes less transparent in the quasisymmetric setting 
since bases for quasisymmetric functions are typically indexed by compositions instead of partitions. That 
is, it is not enough to simply reflect across the main diagonal since this does not necessarily produce a 
left-justified diagram. In fact, the number of compositions which are rearrangements of a given partition is 
generally not equal to the number of compositions which are rearrangements of its transpose so that any 
relationship between these two collections must necessarily be more complex than a simple bijection. There 
is a refinement of uj transformation which is defined on the space of quasisymmetric functions and we shall 
use this refinement to better understand the relationship between the compositions rearranging a partition 
and those rearranging its conjugate. 

The outline of this paper is as follows. In Section [2j we shall briefiy review the background on symmetric 
and quasisymmetric functions that we shall need. In Section [3j we shall recall the definition of the qua- 
sisymmetric Schur function Sa and we shall define the row-strict quasisymmetric Schur functions TZSa ■ We 
shall also describe their relationship to quasisymmetric Schur functions and Schur functions. In Section |4j 
we shall give combinatorial interpretations to the coefficients that arise in the expansion of TiSa in terms 
of both the monomial quasisymmetric functions and the fundamental quasisymmetric functions. This will 
allow us to prove that the row-strict quasisymmetric functions are a basis for the quasisymmetric functions. 
In Section [5] we show that the lo involution on quasisymmetric functions is the involution which interpolates 
between the quasisymmetric Schur functions and the row-strict quasisymmetric Schur functions. Finally in 
Section [6] we shall define an extension of the dual Schensted insertion procedure that is appropriate for 
row-strict quasisymmetric functions and prove some its fundamental properties. This extension is used by 
Ferreira [6j to prove a refinement of the Littlewood-Richardson rule to give a combinatorial interpretation 
of the product of a Schur function times a row-strict quasisymmetric Schur function as a positive sum of 
row-strict quasisymmetric functions. 

2. Symmetric and quasisymmetric functions 

A symmetric function is a bounded degree formal power series f{x) G Q[[a;i, 3:2, . . .]] such that f(x) is fixed 
under the action of the symmetric group; that is, a{f{x)) — f{x) for all a £ &ao where a{f{xi,X2, ■ ■ ■)) — 
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f{xa{i)jXa(2)^ • • ■)■ We let A denote the ring of symmetric functions and A„ denote the space of homogeneous 
symmetric functions of degree n so that A = ®n>o-^n- 

A partition of n is a weakly decreasing sequence A = (Ai, A2, . . . Xk) of positive integers which sum to n. We 
write |A| = n and let l(X) = fc be the length of A. Given a partition A = (Ai, . . . , Xk) of n, we say that a reverse 
column-strict tableau T is a standard reverse column-strict tableau if each of the numbers 1, 2, . . . , n appear 
exactly once in T. Standard reverse row-strict tableaux are defined similarly. Note that the set of standard 
reverse row-strict tableaux is the same as the set of standard reverse column-strict tableaux, so we simply use 
the term reverse standard Young tableau when the tableau is standard. A reverse column-strict tableau can 
be converted to a standard reverse column-strict tableau by a procedure known as standardization. Let T be 
an arbitrary reverse column-strict tableau such that JJ*". First replace (from right to left) 

the oi Is in T with the numbers 1, 2, ... , oi. Then replace the 02 2s with the numbers ai -I- 1, . . . , oi 4- 02, 
and so on. The resulting diagram is a standard reverse column-strict tableau, called the standardization 
stdiT) of T. The standardization of a reverse row-strict tableau is defined analogously to that of a reverse 
column-strict tableau but with the entries replaced from bottom to top rather than from right to left. 

A composition a N n of n is a sequence of positive integers which sum to n. Each composition a = 
(ai, a2, . . . , oik) is associated to the subset of [n — 1] given by S{a) = {ai, 012 — ai, . . . , n — a^}. Note that 
this is an invertible procedure. That is, if P = {si,S2, . . . ,Sfc} is an arbitrary subset of [n ~ 1], then the 
composition /3(F) — (si, si -I- S2, Si -I- S2 + ■•• Sfe) is precisely the composition such that 5(/3(P)) =P. We 
will make use of the refinement order -< on compositions which states that a ^ /3 if and only if j3 is obtained 
from a by summing some of the parts of a. For example, (3, 1, 1, 2, 1) < (3, 2, 3) but (3, 1, 2, 1, 1) and (3, 2, 3) 
are incomparable under the refinement ordering. If a is a composition, let A(a) denote the partition obtained 
by arranging the parts of a in weakly decreasing order. We say that a is a rearrangement of the partition 
\{a). For example, A(l, 3, 2, 1) = (3, 2. 1, 1). If A = (Ai > • • • > A„) and ^ — [jii > • • • > /i„) are partitions 
of n, then we write A > /i if A dominates ^, i.e. if for all 1 < fc < n, we have X]i=i -^i — Si=i Mj- 

We also need the notion of complementary compositions. The complement /3 to a composition I3{S) 
arising from a subset 5 C [n — 1] is the composition obtained from the subset S*"^ C [n — 1]. For example, the 
composition /3 = (1, 4, 2) arising from the subset S = {1, 5} C [7] has complement /? = (2, 1, 1, 2, 1) arising 
from the subset S" = {2, 3, 4, 6, 7}. 

A quasisymmetric function is a bounded degree formal power series f{x) £ Q[[a;i,a;2, . . .]] such that for 
all compositions a = (ai, a2, . . . , a/c), the coefficient of 0^^' equal to the coefficient of 11 ^i^-^ 
ii < 12 < . . . < ik- We let Qsym denote the ring of quasisymmetric functions and Qsyrun denote the space 
of homogeneous quasisymmetric functions of degree n so that Qsym = ®n>oQsym„. 

A natural basis for Qsyrun is the monomial quasisymmetric basis, given by the set of all such that 
a N n where 

il<i2<---<ik 

Gessel's fundamental basis for quasisymmetric functions [7] can be expressed by 

where (3 ^ a means that /3 is a refinement of a. 

The descent set D{T) of a standard tableau is the set of all positive integers i such that i -\- 1 appears in 
a column weakly to the right of the column containing i. The following theorem describes the way a Schur 
function can be expressed as a positive sum of fundamental quasisymmetric functions. 

Theorem 2.1. [7] 
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where dap is equal to the number of standard reverse column- strict tableaux T of shape a and descent set 
D{T) such that P{D{T)) = (3. 

Proof. We claim that each fundamental quasisymmetric function Fa can be thought of as the generating func- 
tion for all reverse column-strict tableaux which standardize to a fixed standard reverse column-strict tableau. 
To see this, consider an arbitrary standard reverse column-strict tableau T with descent set {&i, h^, ■ ■ ■ , bk\- 
Then the cells of T containing the entries + 1,6,-1 + 2,...,fei} appear in horizontal strips, called 

row strips, so that no two such cells appear in the same column in T . Each reverse column-strict tableau 
which standardizes to T can similarly be decomposed into the same collection of row strips, so that each 
destandardization of T corresponds to a coarsening of the weight of T. The coarsest such tableau is the 
reverse column-strict tableau obtained from T by replacing the entries {bi^i -f 1, bi^i -t- 2, . . . , bi\ with the 
entry i. Therefore exactly the monomial quasisymmetric functions indexed by refinements of the composition 
/9({6i, ^2, • • ■ , bk}) occur as the weights of the reverse column-strict tableaux which standardize to T and the 
claim is true. 

The claim implies that the fundamental quasisymmetric functions appearing in the Schur function s\ are 
precisely those corresponding to the descent sets of the standard reverse column-strict tableaux of shape A, 
as desired. □ 

An extension of the classical lj transformation on symmetric functions (defined in the introduction to 
the space of quasisymmetric functions) appears in the work of Ehrenborg 5 , Gessel [7 , and Malvenuto- 
Reutenauer |15j . One can define this endomorphism on the fundamental quasisymmetric functions by 
u){Fa) = F^ev{a)i wherc reu(a) is the composition obtained by reversing the order of the entries in a. 
Then oj is an automorphism of the algebra of quasisymmetric functions whose restriction to the space of 
symmetric function equals the classical uj transformation. 



3. Quasisymmetric Schur functions and row-strict quasisymmetric Schur functions 

Let a — [oil, a2, . . . , Q!i) be a composition of n. The diagram associated to a consists of I rows of left- 
justified boxes, or cells, such that the i*^ row from the top contains ai cells, as in the English notation. 
Given a composition diagram a = (ai, a2, • ■ • , o;;) with largest part m, a column-strict composition tableau 
(CSCT), F is a filling of the cells of a with positive integers such that 

(1) the entries of F weakly decrease in each row when read from left to right, 

(2) the entries in the leftmost column of F strictly increase when read from top to bottom, 

(3) and F satisfies the column-strict triple rule. 

Here we say that F satisfies the column-strict triple rule if when we supplement F by adding enough cells with 
zero-valued entries to the end of each row so that the resulting supplemented tableau, F , is of rectangular 
shape I X m, then for 1 < z < j < 2 < k < m 

{F{j, fc) 7^ and F{j, k) > F{i, fc)) ^ F{j, fc) > F{i, fc - 1) 

where F{i, j) denotes the entry of F that lies in the cell in the i-th row and j-th column. 

Define the type of a column-strict composition tableau F to be the weak composition w(F) — 
{wi{F), W2{F), . . .) where Wi{F) = the number of times i appears in F. The weight of F is 

i 

A CSCT F with n cells is standard if x^ = Y[7=i ^i- If T' is a standard CSCT, then we define its descent set, 
D{T) to be the set of all i such that i + 1 appears in a column weakly to the right of the column containing 
i. 
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Figure 3.1. An RSCT F of shape (2, 1, 2, 1) and weight 

Haglund, Luoto, Mason, and van Willigenburg [8] defined the quasisymmetric Schur function Sa by 

(3.1) = 

F 

where the sum runs over aU column-strict composition tableaux of shape a. They show that Sa as a ranges 
over all compositions of n is a basis for the space Qsyrrin- They also show that for any partition A of n, 

(3.2) sx= 

They provide a combinatorial description of the expansion of Sa in terms of Gessel's fundamental quasisym- 
metric function basis in the following proposition. 

Proposition 3.1. '8', Proposition 6.2] Let a, (3 be compositions. Then 

Sa = ^ dapFp 

P 

where dap = the number of standard column-strict composition tableaux T of shape a and f3{D(T)) — /3. 

Next we define our row-strict version of the quasisymmetric Schur functions. Let a — (qi, a2, . . . , ai) be 
a composition of n. Given a composition diagram a with largest part to, we define a row-strict composition 
tableau (RSCT), F, to be a filling of the cells of a with positive integers such that 

(1) the entries of F strictly decrease in each row when read from left to right, 

(2) the entries in the leftmost column of F weakly increase when read from top to bottom, 

(3) and F satisfies the row-strict triple rule. 

Here we say that F satisfies the row-strict triple rule if when we supplement F by adding enough cells with 
zero-valued entries to the end of each row so that the resulting supplemented tableau, F, is of rectangular 
shape I X to, then ioi 1 < i < j < I, 2 < k < m 

(F(j, k) > F(z, k)) ^ F{j, k) > F{i, k - 1). 

This mirrors the definition of a composition tableau given in [Sj and presented above, interchanging the 
roles of weak and strict. Continuing this analogy, define the type of a row-strict composition tableau F to 
be the weak composition w{F) — {wi{F),W2{F), . . .) where Wi{F) = the number of times i appears in F. 
The weight associated with F is 

i 

Also, a RSCT F with n cells is standard if x^ — Y[i=i ^i- Figure [3] for an example of a RSCT and its 
weight. 

Definition 3.1. Let a be a composition. Then the row-strict quasisymmetric Schur function 7?,iSa is given 

by 

nSa = 5Z 

T 
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Figure 3.2. The row-strict quasisymmetric Schur fuiiction7?,5(2, 1,2, i)(2;i,a;2,a;3,X4) 

X1X2XI + X1X2X3X4 + X1X2X3XI + X1X2XI + XiX2x'^x1 + XiX^xl + X2x\x\ 
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Figure 3.3. The transition matrix from row-strict quasisymmetric Schur functions to qua- 
sisymmetric Schur functions 



where the sum is over ah RSCT's T of shape a. See Figure [3?2] for an example 



Proposition 3.2. If a is an arbitrary composition, then TZSa is a quasisymmetric polynomial. 



Proof. Consider an arbitrary monomial a;"' 
where ii < «2 < • ■ ■ 



that x^lx^ 



■^2 ■ • 

< ik, 



x'k' appearing in TZSa with coefficient c. We must prove 
also appears in TZSa with coefficient c. Each of the c 
appearances of the monomial xl^x'2^ . . .x'^!' in TZSa corresponds to an RSCT T. Renumber the entries of 
T so that each appearance of the entry j becomes ij for each j from 1 to fc. The resulting figure satisfies 
the RSCT conditions since the relative order of the cell entries is not altered by the renumbering procedure. 



Since the renumbering procedure is a bijection between RSCTs of weight x\^x\ 



^ii ^12 ■ ■ ■ 

?1 < 12 < 



0.2 

2 

is equal to the coefficient of x'^^xf^ 



< ik and therefore the polynomial is a quasisymmetric polynomial. 



xl!- and RSCTs of weight 
c°'° for any choice of 
□ 



We shall see in Section 4.2 that the row-strict quasisymmetric Schur functions form a basis for quasisym- 
metric functions. The row-strict quasisymmetric Schur functions in n variables form a basis for Qsynin 
which is different from the basis of Qysrrin formed by the quasisymmetric Schur functions even though they 
can be described through a similar process. For example, the transition matrix between the two bases is 
given in Figure |3.3| for n = 4 where each row gives the expansion of TZSa in terms of the quasisymmetric 
Schur functions. This illustrates that their relationship is fairly complex. 

3.1. Decomposing a Schur function into row-strict quasisymmetric Schur functions. Recall that 
a reverse row-strict tableau T of partition shape A is a filling of the cells of the diagram of A with positive 
integers such that the entries in each column weakly decrease from top to bottom and the entries in each row 
strictly decrease from left to right. Row-strict composition tableaux are related to reverse row-strict tableaux 
by a simple bijection, which is analogous to the bijection between column-strict composition tableaux and 
reverse column-strict tableaux [IB] . 
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Figure 3.4. The bijection p applied to a reverse row-strict tableau T 



The following map sends a reverse row-strict tableau T to a RSCT p{T) = F. We describe it algorithmi- 
cally. 

(1) Begin with the entries in the leftmost column of T and place them into the first column of F in 
weakly increasing order from top to bottom. 

(2) After the first k — 1 columns of T have been placed into F, place the entries from the fc*'* column of 
T into F, beginning with the largest. Place each entry e into the cell (i, k) in the highest row i such 
that (z, k) does not already contain an entry from T and the entry {i, fc — 1) is strictly greater than 
e. 



See Figure 3.4 for an example of the map p from a reverse row-strict tableau T to a RSCT p(T) — F. 



Lemma 3.2. The map p is a weight preserving bijection between the set of reverse row-strict tableaux of 
shape A and the set of RSCT's of shape a where \{a) — A. 

Proof. Given an arbitrary reverse row-strict tableau T, we must first prove that the figure p{T) = F is 
indeed an RSCT. The row entries satisfy the first RSCT condition by construction and the leftmost column 
satisfies the second RSCT condition by construction. Therefore it is enough to show that the row-strict 
triple condition is satisfied. 

Consider the supplemented tableau F and select two entries F{i, k), F{j, k) in the same column of F 
such that F{j,k) ^ and F{j,k) > F{i,k). The entry F{j,k) is inserted into F before F{i,k) since 
F{j,k) > F{i,k). This means that the cell {i,k) of F is empty during the insertion of F{j,k). The entry 
F{i,k — 1) must therefore be less than or equal to F{j,k), for otherwise F{j,k) would be placed into cell 

The shape of p{F) is a rearrangement of A by construction, since the column sets of p(T) are the same 
as the column sets of T. Therefore the map p sends a reverse row-strict tableau of shape A to an RSCT of 
shape a where A(a) A. 

To see that the map is a bijection, we describe its inverse. Given an RSCT F, we create a reverse row-strict 
tableau p~^{F) = T by rearranging the column entries into weakly decreasing order from top to bottom. 
We must prove that the resulting figure is indeed a reverse row-strict tableau. The columns of T are weakly 
decreasing by construction, so we must prove that the rows are strictly decreasing. 

Consider the i*'^ largest entry in the j*'* column of T. This entry appears in F immediately to the right of 
a strictly greater entry, as do all of the i — 1 entries greater than or equal to this entry. Therefore there are 
at least i strictly greater entries in column j — 1 of T and therefore the i*'' largest entry in the j*'' column of 
T appears immediately to the right of a strictly greater entry. Since this is true for all entries in all columns 
of T, the rows of T are strictly decreasing when read from left to right and therefore T is a reverse row-strict 
tableau. □ 



Lemma |3.2| implies that each Schur function sx decomposes into a positive sum of row-strict quasisym- 
metric Schur functions indexed by compositions that rearrange the transpose of A. That is. 



E 

i:A(a) = 



TZSa ■ 
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Figure 4.1. The map p commutes with standardization. 

An arbitrary Schur function can therefore be decomposed into cither a sum of quasisymmetric Schur 
functions 8J or a sum of row-strict quasisymmetric Schur functions. 

4. Properties of the row-srict quasisymmetric Schur functions 

In order to develop several fundamental properties of the row-strict quasisymmetric Schur functions, we 
need to understand the behavior of the map p which interpolates between row-strict composition tableaux 
and reverse row-strict tableaux. 

4.1. Properties of the map p. Recall that a reverse row-strict tableau can be converted to a standard 
Young tableau by the standardization procedure described in Section [2j The standardization of a row-strict 
composition tableau F is defined similarly to that of a reverse row-strict tableau, where the entries are 
replaced beginning with the leftmost column and moving left to right, replacing entries within a column 
from bottom to top except for the entries in the leftmost column, which are replaced from top to bottom. 
The resulting standard composition tableau is called the standardization of F and denoted st{F). See Figure 
|4.1| for an example. Note that this procedure does not alter the shape of F. 

Proposition 4.1. Standardization commutes with the map p in the sense that if T is an arbitrary reverse 
row-strict tableau then st{p(T)) = p{std{T)). 

Proof. The map p does not alter the set of column entries. That is, the set of entries in column c of T are 
equal to the set of entries in column c of p(T). Therefore it is enough to show that the set of entries in an 
arbitrary column of std(T) is equal to the set of entries in the corresponding column of st{p(T)). 

Consider two equal entries in a reverse row-strict tableau. The lower entry must appear weakly left 
of the higher entry since the row entries are strictly decreasing left to right and the column entries are 
weakly decreasing top to bottom. Therefore during the standardization process the entries are replaced 
beginning with the leftmost column and moving left to right. Therefore the set of column entries in an 
arbitrary column of st(T) is equal to the set of entries in the corresponding column of st{p{T)) and thus 
standardization commutes. □ 
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4.2. Transitions to classical quasisymmetric function bases. Each monomial in a row-strict qua- 
sisymmetric Schur function corresponds to a row-strict composition tableau whose weight corresponds to 
the non-zero exponents in the monomial. Consider the monomial with exponent composi- 

tion l3 = (/3i, /32, ■ . • , /3fc)- The coefhcient of this monomial in TZSa is equal to the number of row-strict 
composition tableaux of shape a and weight /3. By shifting the entries in a row-strict composition tableau 
appropriately, it is easy to see that 

where K{a, is the number of row-strict composition tableaux of shape a and weight /?. 

Given a standard row-strict composition tableau its transpose descent set D'{F) is the set of all i 
such that i 1 appears in a column strictly to the left of the column containing i. Since the map p 
preserves the column sets of the diagram, the transpose descent set of a reverse row-strict standard Young 
tableau T (defined analogously) is equal to the transpose descent set of p{T). To each transpose descent 
set S = {si, S2, . . . Sfe} one associates a unique composition (3{S) = (si, S2 ~ si, . . . , — Sk-i,n — Sk) whose 
successive parts are equal to the differences between consecutive elements of the set S and whose last part 
is given by the difference of n and the last element Sk in the set S. 

Next we prove the analogue of Proposition |3 . 1 1 for row-strict quasisymmetric Schur functions. 



Proposition 4.2. Leta,/3 be compositions. Then 

TZSa = ^ dapFp 

where dap is equal to the number of standard row-strict composition tableaux F oj shape a and I3{D'(F)) — /3. 
Proof. We claim that 

(4.1) TlS^^Y.^PiD'iT)), 

T 

where the sum is over all row-strict standard composition tableaux T of shape a. The proposition follows 



easily from this claim since da/^ counts the number of times Fp appears on the right hand side of 4.1 

To prove the claim, first note that TZSa is a sum of monomials arising from row-strict composition tableaux 
of shape a. Each such filling F maps to a reverse row-strict tableau via the bijection p~^, which then maps 
to a reverse column-strict tableau under the transpose bijection. Consider an arbitrary standard reverse 
column-strict tableau T appearing in the image. Since standardization does not alter the shape of the 



composition diagram and commutes with p~^ by Proposition 4.1 all of the reverse column-strict tableaux 
which standardize to T appear in the image. This implies that TZSa is a positive sum of fundamental 
quasisymmetric functions since each fundamental quasisymmetric function is a sum of the monomials arising 
from a standard reverse row-strict tableau T together with the reverse row-strict tableaux which standardize 
to T. 

To determine the fundamental quasisymmetric functions appearing in TZSa , consider an arbitrary standard 
reverse row-strict tableau T appearing in the image of the row-strict composition tableaux of shape a under 
the composition of the maps p~^ and transpose. The descent set D{T) of this tableau determines the 
fundamental quasisymmetric function containing the monomial associated to T by Theorem |2.1[ Recall that 
D{T) is the set of all i such that i + 1 appears in a column weakly to the right of the column containing 

and in fact this means that i -\- 1 must appear in a row strictly above i since the row and column entries 
are decreasing. This implies that in the transpose T' of T the entry z + 1 must appear in a column strictly 
to the left of i and hence i is contained in the transpose descent set. Similarly, if i is not in the descent set 
of T then i -\- \ appears in a row weakly below i and therefore i is not in the transpose descent set of T' . 
The map p preserves transpose descent sets since it preserves the entries in a given column. Therefore the 
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fundamental quasisymmetric functions appearing in TZSa are precisely those indexed by the compositions 
corresponding to the transpose descent sets of the standard row-strict composition tableaux. □ 

Theorem 4.1. The set {TZSa{xi, . . . , Xfe)|Q; N n and k > n} forms a X-basis for QSymn{xi, . . . , Xk). 

Proof. Let Xk denote (xi, . . . , Xfe). It is enough to prove that the transition matrix from row-strict qua- 
sisymmetric Schur functions to fundamental quasisymmetric functions is upper uni-triangular with respect 
to a certain order on compositions. Order the compositions indexing the row-strict quasisymmetric Schur 
functions by the revlex order, >r, where a >r /3 if and only if either A(a) > A(/3) or A(q;) = A(/3) and 

i^iex P- Order the compositions indexing the fundamental quasisymmetric functions by the revlex order 
on their complementary compositions. 

Fix a positive integer n and a composition a = (ai,a2, . . . ,Q!£(q)) of n. Consider a summand i^/3(xk) 
appearing in TZSa{y^Vi) and consider the composition /? complementary to /?. Since k > n we know that 
F^(xk) is nonzero. We claim that A(/3) < A(a) and, moreover, if \{/3) = A(q;) then (3 = a. 

Since -Fjg(xk) appears in 7?.iSQ.(xk), there must exist a standard reverse row-strict composition tableau F 
of shape a with transpose descent set D — {61,62, ■ • -6^:} such that /3(I?) = /?. Each entry i in D must 
appear in F strictly to the right of i -|~ 1. Therefore the consecutive entries in D appear in F as horizontal 
strips. Each such horizontal strip corresponds to a part of /3 since j3 arises from the complement of D. This 
implies that the sum of the largest j parts of /3 must be less than or equal to the sum of the largest j parts 
of a. Therefore A(/3) < \{a). 

Assume that A(/3) = A(a). Since the length of (3 is equal to the length of a, the horizontal strips 
corresponding to the parts of j3 must be left-justified in F and hence the strip corresponding to Pi must 
begin in the i*^ row of a. Therefore /3i > ai since the row entries of F must be strictly decreasing from left 
to right. Iterating this argument implies that j3i = ai for all i, and hence (3 = a as claimed. Therefore the 
transition matrix is upper uni-triangular and the proof is complete. □ 



See Figure 4.2(a) for an example of the transition matrix from the row-strict quasisymmetric Schur 



functions to fundamental quasisymmetric functions for n — A. Figure 4.2(b) gives the transition matrix from 



the quasisymmetric Schur functions to the fundamental quasisymmetric functions for n = 4. 



5. A LINEAR ENDOMORPHISM OF QSyM 

An algebra endomorphism w : A — > A on symmetric functions is defined by w(e„) = /i„, n > 1. The 
definitions of e\ and h\ imply that Lo{e\) ~ h\ since w preserves multiplication. The endomorphism is an 
involution and U!{s\) — sx', where A' is the transpose of the partition A, often referred to as the conjugate 
partition UHl Ellin] ■ 

5.1. An extension of the oj automorphism of symmetric functions. 

Theorem 5.1. The uj operator maps quasisymmetric Schur functions to row-strict quasisymmetric Schur 
functions. That is, 

Uj{Sa{xi, . . .,Xn)) = TZSa{x„, . . .,Xi). 

Proof. Proposition |3.1| states that Sa can be written as a positive sum of fundamental quasisymmetric 
functions in the following way. 



(5.1) 



Saixi, . . . ,a;„) = ^ dai3Fj3{xi, . . . ,Xn), 

13 
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(a) The transition matrix from row-strict quasisymmetric Schur 
functions to fundamental quasisymmetric Schur functions 
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(b) The transition matrix from quasisymmetric Schur func- 
tions to fundamental quasisymmetric Schur functions 



where dap is equal to the number of standard column-strict composition tableaux T of shape a such that 
f3{D{T)) = /3. Apply u to Equation [sl] to get 

Uj{Sa{xi,...,Xn)) = y^^dapiL!{Fi3{xi, . . . ,Xn)) 

p 

= ^dc,pF^^^0~^{xi,...,Xn) 

13 

= y^c?aff-Fg(a;n, ...,Xi) 

= TlSaiXn^-.-^Xi) 

The second equality above results directly from the definition of the w operator on the fundamental qua- 
sisymmetric functions [S], [7], [TS] and the last equality results from the fact that transposing a standard 
Young tableau replaces the descent set D with the complementary set D'^ . □ 

5.2. A notion of conjugation for compositions. The uj operator applied to a Schur function s\ produces 
the Schur function sa' indexed by the conjugate partition to A. Since the quasisymmetric Schur functions 
and the row-strict quasisymmetric Schur functions are generated by sums of monomials arising from fillings 
of composition diagrams, it is natural to seek a conjugation-like operation on composition diagrams which 
preserves the transpose of the underlying partition. 

This idea at first seems to be too much to ask since there cannot be a bijection between compositions 
that rearrange to a given partition A and compositions that rearrange to its conjugate partition A' for all A. 
Consider for example the partition A = (2, 1, 1). There are three compositions ((2, 1, 1), (1, 2, 1) and (1, 1, 2)) 
which rearrange A but only two compositions ((3,1) and (1,3)) which rearrange A' = (3,1). However, the 
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Figure 5.1. The map from a CSCT to an iJS'CT 



w operator can be used to collect the compositions which rearrange a given partition so that there exists a 
bijection between these collections and the collections corresponding to the conjugate partition. In particular, 
note that since uj sends a quasisymmetric Schur function to a row-strict quasisymmetric Schur function, a 
method for writing the quasisymmetric Schur functions in terms of the row-strict quasisymmetric Schur 
functions and vice versa would allow us to interpret the indexing compositions in much the same way as we 
interpret the indexing partitions for Schur functions and their images under lo. 

Recall that the Schur functions can be expanded into sums of either quasisymmetric Schur functions or 
dual quasisymmetric Schur functions as follows: 

A(q) = A A(/3) = A' 

This suggests that there must be a weight-preserving bijection between column-strict composition tableaux 
and row-strict composition tableaux which transposes the shape of the underlying partition. 

Given an arbitrary column-strict composition tableau F, choose the largest entry in each column of F 
and construct the leftmost column of (t){F) by placing these entries (the collection Ci) in weakly increasing 
order from top to bottom. Then choose the second-largest entry from each column of F (ignoring empty 
cells) and insert this collection (C2) into the new diagram by the following procedure. Place the largest entry 

into the highest position in the second column so that the entry immediately to the left of is strictly 
greater than e^. Repeat this insertion with the next largest entry, considering only the unoccupied positions. 
Continue this procedure with the remainder of the entries in this collection from largest to smallest until 
the entire collection has been inserted. Then repeat the procedure for the third largest entry in each column 
(C3) of F and continue inserting collections of entries until all entries of F have been inserted. The resulting 



diagram is (t){F). See Figure 5.2 for an example 



Proposition 5.1. The map (p is a weight-preserving bijection between column-strict composition tableaux 
which rearrange a given partition and row-strict composition tableaux which rearrange the conjugate partition. 

Proof. Wc must first prove that the map (f) is well-defined. Consider the z"* largest entry in an insertion 
collection Cj. This entry is strictly smaller than the entry from its column in Cj-i. It is also weakly smaller 
than the i—\ largest entries in the collection Cj and hence strictly smaller than at least i of the entries in the 
collection Cj_i. Therefore there exists at least one position in which this entry may be placed and the map 
is well-defined. The fact that </> is weight-preserving and conjugates the underlying partition is immediate 
from the definition of 4>. 

To see that (t>{F) is indeed a row-strict composition tableau, first note that conditions (1) and (2) are 
satisfied by construction. Next consider a pair of entries ei and 62 in the same column of 4>{F) such that 
ei < 62 and ei is in a higher row of 4'{F) than 62. Then 62 was inserted before ei and hence the position 
containing ei was available during the insertion of 62- Since 62 was not placed in this position, the entry in 
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Figure 5.2. The compositions (2,1,1) and (1,2,1) are conjugate to (1,3) 



the cell immediately to the left of ei must be weakly smaller than 62- Therefore condition (3) is satisfied 
and (t>{F) is a row-strict composition tableau. 

Let be the map from reverse row-strict tableaux to row-strict composition tableaux given in this 
paper, let be the analogous map from reverse column-strict tableaux to column-strict composition 
tableaux given in [8], and let r be the transposition map that sends a reverse semi-standard Young tableau 
to its conjugate by reflecting across the main diagonal. Then (j> = p^^ o r o p^^. The map (f) is therefore a 
bijection with inverse 4>~^ given by (j3~^ = p^o t o p^. □ 

We note that cj) does not always preserve compositions shapes. That is, it is not necessarily the case if 
Ti and T2 are column strict composition tableaux of the same shape, the (t>(Ti) and 4'{T2) have the same 



shape. See Figure 5.2 for an example. Indeed, its is not possible to define such a shape preserving map since 
the number of compositions that rearrange to A is not always the same as the number of compositions that 
rearrange to A'. 

6. An extension of dual Schensted insertion 

Schensted insertion provides a method for inserting an arbitrary positive integer into an arbitrary column- 
strict tableau. This insertion process forms the foundation for the well-known Robinson-Schensted-Knuth 
(RSK) algorithm which produces a bijection between matrices with non-negative integer coefficients and 
pairs of reverse column-strict tableaux of the same shape. Mason [16| gave an extension of RSK algorithm to 
insert an integer into a column-strict composition tableau and Haglund, Luoto, Mason and van Willigenburg 
[5] used to insertion procedure to prove the refinement of the Littlewood-Richardson rule which gives a 
combinatorial interpretation to the coefficients that arise in the expansion of the product of a Schur function 
times a quasisymmetric Schur function into a positive sum of quasisymmetric Schur functions. 

In this section, we define an extension of dual Schensted insertion. This extension is used by Ferreira [6] 
to give another refinement of the Littlewood- Richard rule which provides a combinatorial interpretation for 
the coefficients that arise in the expansion the product of a Schur function times a row-strict quasisymmetric 
Schur function into a positive sum of quasisymmetric Schur functions. 

Dual Schensted insertion inserts an arbitrary positive integer into a reverse row-strict tableau by bumping 
entries from row to row. That is, given a reverse row-strict tableau T and a positive integer z, first set R 
equal to the first row of T. Let y be the largest entry in R less than or equal to x. Replace yhyx'm R. Set 
X = y and set R equal to the next row down and repeat. If there is no such entry y which is less than or 
equal to x, place x at the end of row R and stop. The resulting figure is denoted T -s— .x. A more detailed 
exposition of Schensted insertion and its variations can be found in [T^] or [TH] . We need only the following 
Lemma concerning the insertion path. 

Lemma 6.1. The insertion path consisting of all cells affected by the insertion process moves weakly to the 
left as the cells are listed from top to bottom. 

The following analogue of dual Schensted insertion provides a method for inserting a new cell into a 
RSCT. Given an arbitrary RSCT F, let read(i^) be the reading word for F given by reading the entries of 
F by column from right to left, reading the columns from top to bottom. This ordering of the cells is called 
the reading order on the cells of F. The modified reading word read(F) for F is given by appending a cell 
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Figure 6.1. read(#) = 002001032222445 
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Figure 6.2. The insertion procedure F ^ 3 



containing the entry after the rightmost ceU in each row to obtain F and then recording the entries of F 



in reading order. (See Figure 6.1 for an example.) 

To insert an arbitrary positive integer x into F, scan read(i^) to find the first entry y less than or equal 
to X such that the entry immediately to the left of y in is greater than x. (If such a y does not exist or if 
y is in the leftmost column, place x after the last entry smaller than or equal to x in the leftmost column, 
shifting the lower rows down by one, and stop.) li y — 0, then replace y hy x and stop. Otherwise, replace 
y by X in which case we say that x bumps y and repeat the procedure using y instead of x and considering 
only the portion of read(-F) appearing after y. The resulting figure is denoted F x. See Figure |6] for an 
example. Note that x followed by all the elements which were bumped in the insertion procedure (read in 
reading order) must form a weakly decreasing sequence. 

Lemma 6.2. The insertion procedure F x produces an RSCT. 

Proof. The insertion procedure F ^ x satisfies the first and second RSCT conditions by construction. To 
see that F' — F ^ x satisfies the triple condition, consider the supplemented tableau F' and select two 
entries F'{i,k),F'{j,k) in the same column of F' such that i < j and F'{j,k) > F'{i,k). Assume that 
F'{j,k) < F'{i,k — 1), for otherwise the triple condition is satisfied. Set a := F'{i,k),b := F'{j,k), and 
c :— F'(i,k — 1). The set of entries affected by the insertion procedure form a weakly decreasing sequence 
when read in reading order, which implies that at most one of the entries a, 6, c is affected by the insertion 
procedure since a < b < c. 

Now it cannot be that a bumped F(i, k) since then column k must have been part of F and it would be 
the case that F(i, k) < a < F{j, k) ~ b < F{i, k — 1) = c which would violate the row-strict triple condition 
in F. 

We also claim that b cannot be involved in the insertion procedure. To see this, assume that b is involved 
and argue by contradiction. In this case, if column k is not part of F, then 6 must have been the terminal 
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cell in the insertion procedure and all the other elements in column k must be 0. Thus, in particular, a = 0. 
In such a situation, we must have tried to insert b in cell (i, k) and the only reason that we did not place b 
in cell {i, k) must have been that b < F(i, k — 1) = c which violates our assumption. Thus it must have been 
that case that column k is in F. Then we claim that b could not have bumped F{j^ k). Otherwise consider 
the element x' which was being inserted by the time that we reached cell (i, k) in the reading order. Since 
either a;' = a; or x' was bumped, we know that x' >b > a. The only reason that x' would not have bumped 
a is if x' > c. In particular, x' ^ b. Now suppose that the set of elements that were bumped in column k 
between row i and row j were i < Si < ■ ■ ■ < St < j ■ Then it must be the case that F{k,st) — b. Thus 
let r be the least element p such that F{sp, k) < c. Now it cannot be that F(sr, k) > a since otherwise we 
would have c = F{i, k — 1) > F{sr, k) > a = F{i, k) which would violate the row-strict triple condition in 
F. But then we would have that a > F(s,-, k) > F{sr+i, k) > ■ ■ ■ > F{st, k) = b since elements the elements 
which are bumped from a weakly decreasing sequence when read in reading order. This also violates our 
assumption so b must not have been involved in the bumping process. 

Thus we must assume that c bumps c' = F{i,k — 1). Note that in this case we have F{i,k) = a < 
F{j, k) ^ b so that we must have c' < b < chy the row-strict triple condition for F. Let d = F{j, fc — 1) and 
e — F{i, k — 2). The cells are arranged in F as depicted below. 



d I b 

Now d > 6 > c' so that the row-strict triple condition for F also implies that d > e. But since c bumps c', 
it must be the case that e > c. Thus we know that d>e>c>b>c'>a. Now consider the question 
of where c came from in the bumping process. It cannot be that c = a; or c came from a cell before (j, k) 
since otherwise we would insert c into (j, k) since we have shown that d > c > b. Thus c must have come 
from a cell after (j, k). Now c could not have come from a cell (s, k) with s > j since then we would have 
that F{j, k) = b < F{s, k) = c < F{j, k — 1) = d which would violate the row-strict triple condition in F. 
Thus c must have been bumped from column fc — 1. Now let (ti, fc — 1), . . . , (tg, k — 1) = {i,k — 1) be the 
cells in column fc — 1 whose elements were bumped in the insertion process weakly before bumping c', where 
ti < ■ ■ ■ < tg. Then we know that s > 1 and 

F{ti, fc - 1) > • • • > F{ts-i, fc - 1) = c> F{ts, fc - 1) = c'. 

Moreover since F(tp, fc — 1) bumps F{tp+i, fc — 1) for 1 < p < s, it must also be the case that F{tp, fc — 1) < 
_F(ip+i, fc — 2) for 1 < p < s. In particular, we know that d — F{j, fc — 1) > e = F(ts, fc — 2) > _F(ts-i, fc — 1) 
so that the row-strict triple condition for F implies that d > F{ts^i, fc — 2). But then d > F{ts-i, fc — 2) > 
-F(is-2jfc — 1) so that row-strict triple condition for F implies that d > F{ts-2,k — 2). Continuing on in 
this way, we can conclude that d > F{ti, fc — 2) > F{ti, fc — 1). Now consider which element / could have 
bumped F{ti, k — 1). This element / must have come from column fc or higher. Now we know that 

d > F{ti, fc - 2) > / > F{ti,k - 1) > F{ts,k -l)=c>b. 

Thus / could not be x or come from a cell before {j, fc) since otherwise we would try to insert / in cell 
(j, fc) and since d > f > b, f would bump b. Thus / = F{r, fc) where r > j. But then we would have that 
d = F{j, fc — 1) > F{r, k) — f > F{j, k) — b which would violate the row-strict triple condition for F. Thus 
we can conclude that c also was not involved in the insertion procedure which would mean that a, 6, and c 
would violate the row-strict triple condition for F. Hence, there can be no violation of the row-strict triple 
condition in F', so F' is a RSCT. □ 

Our extension of the dual Schensted algorithm has a number of nice properties in addition to Ferreira's 
Littelwood- Richardson result [B]. In particular, it is straightforward to prove that the following theorems. 
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Figure 6.3. An example of Theorem [O 



Theorem 6.3. The insertion procedure on RSCT commutes with the reverse row insertion in the sense that 
p{T ^ x) = p{T) ^ X. 

See Figure ?? for an example of Theorem |6.3[ 



Theorem 6.4. There exists a bijection between N-matrices with finite support and pairs {F, G) of row-strict 
composition tableaux which rearrange the same partition. 
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